Exploring quantitative measures in metacognition of emotion.

Metacognition of emotion (meta-emotion) refers to the ability to evaluate and identify one's emotional feelings. No previous study has defined and measured this construct through objective and quantitative procedures. We established a reliable method to measure meta-emotion. With a two-interval forced-choice procedure, participants selected which of two pictures elicited stronger positive emotion; via the Law of Comparative Judgment, their responses were used to compute individual psychological distances for the emotional responses triggered by the pictures. Then, participants were asked to judge whether a pre-exposed picture induced a stronger positive emotion than the median of that elicited by the whole picture set, followed by a confidence rating. By utilizing each individual's psychological distance, the correctness of a participant's emotional experience was quantified by d', and meta-emotion was quantified using meta-d', M-ratio, and M-diff as indices of metacognitive sensitivity and efficiency based on Signal-Detection Theory. Test-retest reliabilities, validated by Spearman correlation, were observed in meta-d', M-ratio, and marginally with M-diff, suggesting the stability of meta-emotion in the current design. This study unveils a validated procedure to quantify meta-emotion, extendable for assessing metacognition of other subjective feelings. Nevertheless, caution is warranted in interpretation, as the measured processes may be influenced by non-metacognitive factors.

The cross-race effect in automatic facial expression recognition violates measurement invariance.

Emotion has been a subject undergoing intensive research in psychology and cognitive neuroscience over several decades. Recently, more and more studies of emotion have adopted automatic rather than manual methods of facial emotion recognition to analyze images or videos of human faces. Compared to manual methods, these computer-vision-based, automatic methods can help objectively and rapidly analyze a large amount of data. These automatic methods have also been validated and believed to be accurate in their judgments. However, these automatic methods often rely on statistical learning models (e.g., deep neural networks), which are intrinsically inductive and thus suffer from problems of induction. Specifically, the models that were trained primarily on Western faces may not generalize well to accurately judge Eastern faces, which can then jeopardize the measurement invariance of emotions in cross-cultural studies. To demonstrate such a possibility, the present study carries out a cross-racial validation of two popular facial emotion recognition systems-FaceReader and DeepFace-using two Western and two Eastern face datasets. Although both systems could achieve overall high accuracies in the judgments of emotion category on the Western datasets, they performed relatively poorly on the Eastern datasets, especially in recognition of negative emotions. While these results caution the use of these automatic methods of emotion recognition on non-Western faces, the results also suggest that the measurements of happiness outputted by these automatic methods are accurate and invariant across races and hence can still be utilized for cross-cultural studies of positive psychology.

Enhanced human contrast sensitivity with increased stimulation of melanopsin in intrinsically photosensitive retinal ganglion cells.

The intrinsically photosensitive retinal ganglion cells (ipRGCs) are known to serve non-image-forming functions, such as photoentrainment of the circadian rhythm and pupillary light reflex. However, how they affect human spatial vision is largely unknown. The spatial contrast sensitivity function (CSF), which measures contrast sensitivity as a function of spatial frequency, was used in the current study to investigate the function of ipRGCs in pattern vision. To compare the effects of different background lights on the CSF, we utilized the silent substitution technique. We manipulated the stimulation level of melanopsin (i.e., the visual pigment of ipRGCs) from the background light while keeping the cone stimulations constant, or vice versa. We conducted four experiments to measure the CSFs at various spatial frequencies, eccentricities, and levels of background luminance. Results showed that melanopsin stimulation from the background light enhances spatial contrast sensitivity across different eccentricities and luminance levels. Our finding that melanopsin contributes to CSF, combined with the receptive field analysis, suggests a role for the magnocellular pathway and challenges the conventional view that ipRGCs are primarily responsible for non-visual functions.

Sequential processing facilitates Hebb repetition learning in visuospatial domains.

Exposure to the same information improves auditory/verbal short-term memory performance, but such improvement is not always observed in visual short-term memory. In this study, we demonstrate that sequential processing makes visuospatial repetition learning efficient in a paradigm that employs a similar design previously used for an auditory/verbal domain. When we presented sets of color patches simultaneously in Experiments 1-4, recall accuracy did not increase with repetition; however, once color patches were presented sequentially in Experiment 5, accuracy did increase rapidly with repetition, even when participants engaged in articulatory suppression. Moreover, these learning dynamics matched those in Experiment 6, which used verbal materials. These findings suggest that (a) sequential focus on each item facilitates a repetition learning effect, indicating a temporal bottleneck is involved early in this process and (b) repetition learning is mechanistically similar across sensory modalities even though these modalities differently specialize in processing spatial or temporal information. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The Effects of Social Presence and Familiarity on Children-Robot Interactions.

In children-robot interactions, an impression of a robot's "social presence" (i.e., an interactive agent that feels like a person) links positively to an improved relationship with the robot. However, building relationships takes many exposures, and there is an intellectual gap in how social presence and familiarity collaborate in modulating children-robot relationships. We investigated whether social presence altered over time, how repeated exposure and social presence affected rapport, and how social presence would modulate children's attitudes toward the robot. Fourteen children (four female, age = 10.79 ± 1.12) interacted with a companion robot for four days in spontaneous interactions. The findings revealed that children who perceived the robot as having a higher social presence developed a stronger rapport than those who perceived a lower social presence. However, repeated encounters did not change the children's perceptions of the robot's social presence. Children rated higher rapport after repeated interactions regardless of social presence levels. This suggests that while a higher social presence initially elevated the positive relationship between children and the robot, it was the repeated interactions that continued solidifying the rapport. Additionally, children who perceived a higher social presence from the robot felt less relational uneasiness about their relationship with robots. These findings highlight the importance of robots' social presence and familiarity in promoting positive relationships in children-robot interaction.

Blue-light background impairs visual exogenous attention shift.

Previous research into the effects of blue light on visual-spatial attention has yielded mixed results due to a lack of properly controlling critical factors like S-cone stimulation, ipRGCs stimulation, and color. We adopted the clock paradigm and systematically manipulated these factors to see how blue light impacts the speed of exogenous and endogenous attention shifts. Experiments 1 and 2 revealed that, relative to the control light, exposure to the blue-light background decreased the speed of exogenous (but not endogenous) attention shift to external stimuli. To further clarify the contribution(s) of blue-light sensitive photoreceptors (i.e., S-cone and ipRGCs), we used a multi-primary system that could manipulate the stimulation of a single type of photoreceptor without changing the stimulation of other photoreceptors (i.e., the silent substitution method). Experiments 3 and 4 revealed that stimulation of S-cones and ipRGCs did not contribute to the impairment of exogenous attention shift. Our findings suggest that associations with blue colors, such as the concept of blue light hazard, cause exogenous attention shift impairment. Some of the previously documented blue-light effects on cognitive performances need to be reevaluated and reconsidered in light of our findings.

Role of visual awareness on semantic integration of sequentially presented words: An fMRI study.

Reading comprehension requires the semantic integration of words across space and time. However, it remains unclear whether comprehension requires visual awareness for such semantic integration. Compared to earlier studies that investigated semantic integration indirectly from its priming effect, we used functional magnetic resonance imaging (fMRI) to directly examine the processes of semantic integration with or without visual awareness. Specifically, we manipulated participants' visual awareness by continuous flash suppression (CFS) while they viewed a meaningful sequence of four Chinese words (i.e., an idiom) or its meaningless counterpart (i.e., a random sequence). Behaviorally, participants had better recognition memory for idioms than random sequences only when their visual awareness was interfered rather than blocked by CFS. Neurally, semantics-processing areas, such as the superior temporal gyrus and inferior frontal gyrus, were significantly activated only when participants were aware of word sequences, be they meaningful or meaningless. By contrast, orthography-processing areas, such as the fusiform gyrus and inferior occipital gyrus, were significantly activated regardless of visual awareness or word sequence. Taken together, these results suggest that visual awareness modules the functioning of the semantic neural network in the brain and facilitates reading comprehension.

Theta activity in semantic priming under visual crowding as revealed by magnetoencephalography.

Crowding refers to impaired object recognition of peripheral visual targets caused by nearby flankers. It has been shown that the response to a word was faster when it was preceded by a semantically related than unrelated crowded prime, demonstrating that semantic priming survives crowding. This study examines neural correlates of semantic priming under visual crowding using magnetoencephalography with four conditions: prime (isolated, crowded) x prime-target relationship (related, unrelated). Participants judged whether the target was a word or a nonword. We found significant differences in θ activity at the left inferior frontal gyrus (IFG) for both isolated and crowded primes when comparing the unrelated and related conditions, although the activation was delayed with the crowded prime compared to the isolated prime. The locations within the IFG were also different: theta-band activation was at BA 45 in the isolated condition and at BA 47 in the crowded condition. Phase-locking-value analysis revealed that bilateral IFG was more synchronized with unrelated prime-target pairs than related pairs regardless of whether the primes were isolated or crowded, indicating the recruitment of the right hemisphere when the prime-target semantic relationship was remote. Finally, the distinct waveform patterns found in the isolated and crowded conditions from both the source localization and PLV analysis suggest different neural mechanisms for processing semantic information with isolated primes versus crowded primes.

An Effective Entropy-Assisted Mind-Wandering Detection System Using EEG Signals of MM-SART Database.

Mind-wandering (MW), which is usually defined as a lapse of attention has negative effects on our daily life. Therefore, detecting when MW occurs can prevent us from those negative outcomes resulting from MW. In this work, we first collected a multi-modal Sustained Attention to Response Task (MM-SART) database for MW detection. Eighty-two participants' data were collected in our dataset. For each participant, we collected measures of 32-channels electroencephalogram (EEG) signals, photoplethysmography (PPG) signals, galvanic skin response (GSR) signals, eye tracker signals, and several questionnaires for detailed analyses. Then, we propose an effective MW detection system based on the collected EEG signals. To explore the non-linear characteristics of the EEG signals, we utilize entropy-based features. The experimental results show that we can reach 0.712 AUC score by using the random forest (RF) classifier with the leave-one-subject-out cross-validation. Moreover, to lower the overall computational complexity of the MW detection system, we propose correlation importance feature elimination (CIFE) along with AUC-based channel selection. By using two most significant EEG channels, we can reduce the training time of the classifier by 44.16%. By applying CIFE on the feature set, we can further improve the AUC score to 0.725 but with only 14.6% of the selection time compared with the recursive feature elimination (RFE). Finally, we can apply the current work to educational scenarios nowadays, especially in remote learning systems.

Age-Related Differences in the Neural Processing of Idioms: A Positive Perspective.

We examined whether older adults benefit from a larger mental-lexicon size and world knowledge to process idioms, one of few abilities that do not stop developing until later adulthood. Participants viewed four-character sequences presented one at a time that combined to form (1) frequent idioms, (2) infrequent idioms, (3) random sequences, or (4) perceptual controls, and judged whether the four-character sequence was an idiom. Compared to their younger counterparts, older adults had higher accuracy for frequent idioms and equivalent accuracy for infrequent idioms. Compared to random sequences, when processing frequent and infrequent idioms, older adults showed higher activations in brain regions related to sematic representation than younger adults, suggesting that older adults devoted more cognitive resources to processing idioms. Also, higher activations in the articulation-related brain regions indicate that older adults adopted the thinking-aloud strategy in the idiom judgment task. These results suggest re-organized neural computational involvement in older adults' language representations due to life-long experiences. The current study provides evidence for the alternative view that aging may not necessarily be solely accompanied by decline.

Seeing food fast and slow: Arousing pictures and words have reverse priorities in accessing awareness.

Previous studies have shown that stimuli triggering higher arousal (e.g., attractiveness) can access awareness faster than those triggering lower arousal, yet no studies have examined the effect of food calories. Since food brings us energy, satiety, and positive emotions, food stimuli bringing higher arousal would likely have higher priority in accessing awareness over those with lower arousal. We used high-calorie and low-calorie food stimuli as representatives for high and low arousal stimuli, respectively, based on the tight relationship between calorie and arousal. By adopting the breaking continuous flash suppression (b-CFS) paradigm, we had high-calorie and low-calorie food pictures or words presented dichoptically with dynamic Mondrian masks and measured the time for food stimuli to be released from suppression. Our results showed that high-calorie food pictures could access visual awareness faster than low-calorie food pictures (Experiment 1), and the reverse pattern was observed for food words (Experiment 2). We ruled out the possibility of the difference in low-level features (Experiment 3) and post-perceptual response bias (Experiment 4) as the causes for the observed b-CFS time differences. This study revealed the dissociation of the unconscious processing of pictures and words, which may rely on mechanisms related to attentional capture. High-arousing stimuli do not always enjoy priority in accessing visual awareness.

Intrinsic neural activity predisposes susceptibility to a body illusion.

Susceptibility to the rubber hand illusion (RHI) varies. To date, however, there is no consensus explanation of this variability. Previous studies, focused on the role of multisensory integration, have searched for neural correlates of the illusion. But those studies have failed to identify a sufficient set of functionally specific neural correlates. Because some evidence suggests that frontal α power is one means of tracking neural instantiations of self, we hypothesized that the higher the frontal α power during the eyes-closed resting state, the more stable the self. As a corollary, we infer that the more stable the self, the less susceptible are participants to a blurring of boundaries-to feeling that the rubber hand belongs to them. Indeed, we found that frontal α amplitude oscillations negatively correlate with susceptibility. Moreover, since lower frequencies often modulate higher frequencies, we explored the possibility that this might be the case for the RHI. Indeed, some evidence suggests that high frontal α power observed in low-RHI participants is modulated by δ frequency oscillations. We conclude that while neural correlates of multisensory integration might be necessary for the RHI, sufficient explanation involves variable intrinsic neural activity that modulates how the brain responds to incompatible sensory stimuli.

Accessing Semantic Information from Above: Parafoveal Processing during the Reading of Vertically Presented Sentences in Traditional Chinese.

As traditional Chinese readers are familiar with reading texts both horizontally rightwards and vertically downwards, the traditional Chinese script provides us a chance to investigate the influence of reading direction on preview benefits by ruling out the confounding factor of different familiarities with reading directions. The present study examines whether parafoveal information can be obtained when reading Chinese sentences in the vertical direction. We manipulated semantic and phonological relatedness between parafoveal preview words and target words. Results showed that traditional Chinese readers could obtain semantic information from preview words; however, there was no phonological preview benefit. Our findings agree with the notion that Chinese characters are well-optimized for semantic access.

Assessing Perceptual Load and Cognitive Load by Fixation-Related Information of Eye Movements.

Assessing mental workload is imperative for avoiding unintended negative consequences in critical situations such as driving and piloting. To evaluate mental workload, measures of eye movements have been adopted, but unequivocal results remain elusive, especially those related to fixation-related parameters. We aimed to resolve the discrepancy of previous results by differentiating two kinds of mental workload (perceptual load and cognitive load) and manipulated them independently using a modified video game. We found opposite effects of the two kinds of mental workload on fixation-related parameters: shorter fixation durations and more fixations when participants played an episode with high (vs. low) perceptual load, and longer fixation durations and fewer fixations when they played an episode with high (vs. low) cognitive load. Such opposite effects were in line with the load theory and demonstrated that fixation-related parameters can be used to index mental workload at different (perceptual and cognitive) stages of mental processing.

Identifying Mild Cognitive Impairment by Using Human-Robot Interactions.

BACKGROUND: Mild cognitive impairment (MCI), which is common in older adults, is a risk factor for dementia. Rapidly growing health care demand associated with global population aging has spurred the development of new digital tools for the assessment of cognitive performance in older adults. OBJECTIVE: To overcome methodological drawbacks of previous studies (e.g., use of potentially imprecise screening tools that fail to include patients with MCI), this study investigated the feasibility of assessing multiple cognitive functions in older adults with and without MCI by using a social robot. METHODS: This study included 33 older adults with or without MCI and 33 healthy young adults. We examined the utility of five robotic cognitive tests focused on language, episodic memory, prospective memory, and aspects of executive function to classify age-associated cognitive changes versus MCI. Standardized neuropsychological tests were collected to validate robotic test performance. RESULTS: The assessment was well received by all participants. Robotic tests assessing delayed episodic memory, prospective memory, and aspects of executive function were optimal for differentiating between older adults with and without MCI, whereas the global cognitive test (i.e., Mini-Mental State Examination) failed to capture such subtle cognitive differences among older adults. Furthermore, robot-administered tests demonstrated sound ability to predict the results of standardized cognitive tests, even after adjustment for demographic variables and global cognitive status. CONCLUSION: Overall, our results suggest the human-robot interaction approach is feasible for MCI identification. Incorporating additional cognitive test measures might improve the stability and reliability of such robot-assisted MCI diagnoses.

Social Robots for Evaluating Attention State in Older Adults.

Sustained attention is essential for older adults to maintain an active lifestyle, and the deficiency of this function is often associated with health-related risks such as falling and frailty. The present study examined whether the well-established age-effect on reducing mind-wandering, the drift to internal thoughts that are seen to be detrimental to attentional control, could be replicated by using a robotic experimenter for older adults who are not as familiar with online technologies. A total of 28 younger and 22 older adults performed a Sustained Attention to Response Task (SART) by answering thought probes regarding their attention states and providing confidence ratings for their own task performances. The indices from the modified SART suggested a well-documented conservative response strategy endorsed by older adults, which were represented by slower responses and increased omission errors. Moreover, the slower responses and increased omissions were found to be associated with less self-reported mind-wandering, thus showing consistency with their higher subjective ratings of attentional control. Overall, this study demonstrates the potential of constructing age-related cognitive profiles with attention evaluation instruction based on a social companion robot for older adults at home.

When Eyes Wander Around: Mind-Wandering as Revealed by Eye Movement Analysis with Hidden Markov Models.

Mind-wandering has been shown to largely influence our learning efficiency, especially in the digital and distracting era nowadays. Detecting mind-wandering thus becomes imperative in educational scenarios. Here, we used a wearable eye-tracker to record eye movements during the sustained attention to response task. Eye movement analysis with hidden Markov models (EMHMM), which takes both spatial and temporal eye-movement information into account, was used to examine if participants' eye movement patterns can differentiate between the states of focused attention and mind-wandering. Two representative eye movement patterns were discovered through clustering using EMHMM: centralized and distributed patterns. Results showed that participants with the centralized pattern had better performance on detecting targets and rated themselves as more focused than those with the distributed pattern. This study indicates that distinct eye movement patterns are associated with different attentional states (focused attention vs. mind-wandering) and demonstrates a novel approach in using EMHMM to study attention. Moreover, this study provides a potential approach to capture the mind-wandering state in the classroom without interrupting the ongoing learning behavior.

In search of blue-light effects on cognitive control.

People are constantly exposed to blue light while engaging in work. It is thus crucial to understand if vast exposure to blue light influences cognitive control, which is essential for working efficiently. Previous studies proposed that the stimulation of intrinsically photosensitive retinal ganglion cells (ipRGCs), a newly discovered photoreceptor that is highly sensitive to blue light, could modulate non-image forming functions. Despite studies that showed blue light (or ipRGCs) enhances brain activations in regions related to cognitive control, how exposure to blue light changes our cognitive control behaviorally remains elusive. We examined whether blue light influences cognitive control through three behavioral tasks in three studies: the sustained attention to response task (SART), the task-switching paradigm, and the Stroop task. Classic effects of the SART, switch cost, and the Stroop effect were found, but no differences were observed in results of different background lights across the six experiments. Together, we conclude that these domains of cognitive control are not influenced by blue light and ipRGCs, and whether the enhancement of blue light on brain activities extends to the behavioral level should be carefully re-examined.

Understanding the collinear masking effect in visual search through eye tracking.

Recent research has reported that, while both orientation contrast and collinearity increase target salience in visual search, a combination of the two counterintuitively masks a local target. Through eye-tracking and eye-movement analysis with hidden Markov models (EMHMM), here we showed that this collinear masking effect was associated with reduced eye-fixation consistency (as measured in entropy) at the central fixation cross prior to the search display presentation. As a decreased precision of saccade landing position is shown to be related to attention shift away from the saccadic target, our result suggested that the collinear masking effect may be related to attention shift to a non-saccadic-goal location in expectation of the search display before saccading to the central fixation cross. This attention shift may consequently interfere with attention capture by the collinear distractor containing the target, resulting in the masking effect. In contrast, although older adults had longer response times, more dispersed eye-movement pattern, and lower eye-movement consistency than young adults during visual search, the two age groups did not differ in the masking effect, suggesting limited contribution from ageing-related cognitive decline. Thus, participants' pre-saccadic attention shift prior to search may be an important factor influencing their search behavior.

Blue-light effects on saccadic eye movements and attentional disengagement.

People are constantly exposed to high-energy blue light as they spend considerable amounts of time reading and browsing materials on electronic products like computers and cellphones. Recent studies suggest that the stimulation of intrinsically photosensitive retinal ganglion cells (ipRGCs)-a newly discovered type of photoreceptor shown to be particularly sensitive to blue light-activates brain regions related to eye movements and attentional orienting (e.g., frontal eye fields). It remains unclear, however, whether and how blue light affects eye movements and attention behaviorally. We examined this by adopting the gap paradigm in which participants made saccades to a peripheral target as quickly and accurately as possible while the fixation sign vanished (i.e., the gap condition) or remained visible. Participants were exposed to blue and orange light on two separate days. Faster saccade latency under blue light was found across two experiments, and the results indicate that blue light shortened saccade latency when attention and eye movements operate simultaneously. Our findings provide evidence for the blue-light facilitatory effect on eye movements and attentional disengagement, and suggest that blue light can enhance the speed of saccadic eye movements.